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THE TO STUDY KULTIPI2 SKILLS 

Barbara Ivory 5?iillaris 

'Sibree studies of liatfceaatics ^Jtoring were designed 
and conducted at ?ar West Zaixjratory for Educational Besearch 
and Develop^ient using three populations of tutors — teaciers, 
paraprofessionais, and students. Each study «as designed 
to address three general areasi (1) the effect of tutoring 
on the achievesent and attitudes of fourth and/or fifth 
grade pupils; (2) the effect of training 2x1 tutorial slcills 
on the achievement and attitudes of fourth and/or fifth 
grade pupils; and (3) the relationships between use of speci- 
fic tutorial sicills and ^vpxl outcones. It is this third 
area which is the donain of the present paper. 

Tutor Skills 

Minicourse 5; Individualizing Instruc tion in 
Matheniatics was used as the training vehicle for each cf the 
three studies, although the materials were adpated for use 
with the student tutors. The tutorial slcills which are 
taught in the Minicourse include: 

1. Use of Diagnostic Questions 

These questions were ones which tested the student's 
understanding of concepts and procedures necessary 
for the solution of particular problems and were 
of five types: (1) general diagnostic guestxons; 
(2) questions which tested the student's abxlity 
to read a problem; (3) questions that tested tne 
students understanding of word defxnxtxons; (4 J 
questions that tested the student's understandxng 
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of nvz±>er con<^ptsj anfl CS) questions that askea 
the stnfient to identify nuciber operations appropri- 
ate to the solution of a given problesi. 



4. 



5. 



Use of Prcrpting questions 

53iese questions encouraged a pupil to perfom 
a pajTtxaalar niTT^ber operation or discover the 
solution to a prcbien. 

Use of gencns tration tecianiqt»zs 

Six desionstration techniques m^ere taught in the 
Minicourse. 53iey included: (1) estisnation; 

(2) diagrams or pictures; (3) ntrmber sentences; 

(4) expanded notation; (5) nurober lines; and 

(6) nanipulative zaaterials. 

"She use of Verbal Praise 

Verbal praise was defined as the oral rewarding 
of a student who has given the desired or correct 
response. Although the JSinicourse differentiated 
general pradLse and specific praise, no distinction 
was siade between the two types pf praise due to 
the results of the snain field test of the Minicourse 
(Gall, 1973) in which specific praise occurred 
infrequently. 

Assignment of Evaluation problems 

Evaluation problems are those mathematical problems 
which are given to a tutored pupil to assess the 
pi^il's understanding of number operations and 
smathematical processes. 

Assignment of Practice Problems 

Practice problems were defined as those mathema- 
tics problems which were given to a pupil i^o 
provide additional es^erience in demonstrating 
understanding of number operations and mathematical 
processes after the completion of a tutoring session. 



to the nature of the tutorial setting, a number 



as potentially iacportant variables. These variables 




Skills or interpersonal behaviors were 



3. 



vera: 



1. Declarative Statenents 

Siose statements vhich providea the piroil vith 
problea-solvisg iaforsiation that otherwise couid 
have been obtaiiied f rcza the tutored pupil vera 
considered declarative stateisents^ 

2* Constructive Criticisa 

Ihe tutors response to student error vas considered 
constructive criticisn as long as no element of 
recrimination could be detected* 

3* Recrimination 

itecrinination vas defined as occurring when the 
tutor's criticism gave the clear is^^lication that 
the pupil should have been doing something else^ 
with a net effect of discouraging the piipil from 
further ventures* 

4* Bapport 

!Efce tone of the tutoring session "was defined in 
terms of the pupil's willingness to be cooperative 
and the tutor's ability to induce a relaxed, but 
productive atmosphere. 

5, Use of Motivating Statements 

Tutor statements at the conclusion of the tutoring 
session which were clearly intended to provide 
encouragement to the tutored pupil were called 
motivating statements. 



In Table 1, each of the above variables is listed 
along with the nature of the data which defined the variable. 

The data for these vari2d>les were collected live in the 
tutoring sessions by observers who were trained in an adapta- 
tion of the Flanders Interaction Analysis Coding System 
(Fla'iderS/ 1970). Coding occurred at three second intervals/ 
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^tor Variables Studies in the 
Xathesatics Tatoriug Studies 



liaaUHE OF TSS Djoa 



Diagnostic Questions 



3nean nisrsber of diagnostic questions 
observed for one tutor across all 
obseirved tutoring sessions — 
soaiaed over tutored pupils 



Prompting Questions 



Tft^an niusber of proir5>ting questions 
for one tutor across all observed 
tutoring sessions 



Use of Demonstration 
Techniques (frequency) 



tTvaan nusber of desaonstration 
techniques used in the observed 
tutoring sessions by one tutor 



Use of Demonstration 
Techniques (time) 



znean number of seconds spent using 
expanded notation/' the number line/ 
and manipulative materials for 
one tutor across observed iutoring 
sessions 



Use of Verbal Praise 



mean number of instances of 
praise among the tutored pupils 
of one tutor 
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Assignment of Evaluation 
Problems (s) 


the mean of this dichotomous tutor 
skill represented the variable 


Assignment of Practice 
Problem (s) 


the meaui of this dichotomous tutor 
skill represented the variable 
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Delcarative Statements 



snean ntrdber of statezr^ents observed 
for one tutor across observed 
sessions 



Constructive Criticisn 



snean nuriber of instances of construc- 
tive criticism recorded across all 
observed sessions 



Becrini nation 



Fvean nuriber of instances of recria- 
ination recorded across all obseirved 
sessions 



Rapport 



rated 1 {no rapport) to 9 

(extremely good rapport) and averaged 

across all pupils of a given tutor 



Motivating Statesients 



inesui of the dichotoiaous tutor 
sicill represented the variable 
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unless ±he interaction ctangea within the fcice interval^ and 

was recorded on the Jiatheziatics Tutoring Observation Fona 

^ J. 

(oee Table 2) . f\ 

Analyses and insults ^ 

Begression analysis procedures were proposed in order 
investigate the relationship of the tutoring shills and 
interpersonal behaviors to pupil outconies- !i2ie specific 
pi^il outcomes were^ 

1. Mathematics achievement 

Computational skills were jneasured by the com- 
putation section of the C^irorehensive Tests of 
Basic Skills and Under stan^Jig of mathematical 
concepts wais measured by the Kodem Hath Supplement 
to the Xowa Tests of Basic Skills* In the case 
of the Cross-Age Tutoring Study, general mathe- 
matics ability was assessed iising a teacher-like 
test — The Far Wast Laboratory Math Test. 

2. Self concept 

Academic and mathematics self-concept were examined 
using the Kodified Sears Self -Concept Inventory. 

3. Attitude Toward Mathematics 

Attitude toward mathematics was assessed using 
the Dutton-Ifikert Attitude toward Mathematics 
Scale. 

4. External Locus of Control 

The Feelings About Math Scales, developed at Far 
West Laboratory, was used to determine whether 
tutoring in mathematics affected pupils* perception 
of the reinforcement which influenced them in the 
area of mathematics. 
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. For the Teacher and Paraprofessional Studies, all 
dependent and independent variables were arranged into a 
priori clusters. Cluster A con£^ined pupil pretest scores 
on all the dependent measures.. Cluster B contained the 

questions / prcupting questions, evaluation problems/ and 
practice 'problems. Cluster C contained the demonstration 
/techniques^ both time a:ad frequency and assessed the skill- 
fulness of the tutor in yising these techniques. Cluster D 
was made up of al^ interpersonal tutor behaviors: praise , 
rapport/ motivating statements/ declarative statements/ 
constructive criticism/ and recrimination. Cluster E which 
contained treatment dummy variable and differentiated between 
those tutors who had received tutorial training and those 
who had not. 

The five clusters of variables were entered into 
multiple regression equations for each of the six posttest 
variables at^both the j^ourth and fifth grade levels. Squared 
multiple"^(^reiations (SMC) were computed for various coiribi- 

nations of predictor clusters and then used to compute esti- 

\ 

mates of^Jthe unique contribution to variance of each cluster 
of variables. 

\ 

The results of the communality regression analyses 
, for 1:he Teacher Study are presented in Table 3 through 8, 
Each table presents the fourth and fifth grade results for 

10 ' - ' 



9. 

one of the six pdsttest variables. Listed in each table are 
the squared mutliple correlations for each cluster indivi- 
dually for the five possible combinations of four clusters 
at a time and for all five clusters combined. Also listed 
in the tables are the uniqueness estimates for each cluster.' 

Inspection of the six tables will show that the pupil 
pretest scores accotsnted for the greatest amount of variance 
in posttest scores for each vari2d>le with the notable excep- 
tion of the fifth grade ITBS. After accotmting for the 
unique variance attributable to pupils' initial status. 
Cluster D which contained the interpersonal behaviors of 
tutors provided a small unique contribution to variance 
for most dependent measures, followed by Cluster B which 
containefJ the performance tutoring skills. These results 
were similar to those ob^^ined in the Paraprofessional Study, 
and therefore/ that study will not -be 'reported separately. 

The net result of these analyses indicated, that tutoring 
skills and interpresonal behaviors, as contained in Cluster 
D and B, had a small relationship to mathematics achievement 
as measured by the CTBS and ITBS. These same clusters also 
had relatively large uniqueness estimates for the fifth 
grade attitude toward mathematics measure and external locus 
of contrbl measure. 

A somewhat different analysis approach was used 
in an attempt to determine the relationships between tutorial 
skills and pupil outcoipes in the Cross-Age Tutoring Study. 
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TABLE 3 

Squared Multiple Correlations and Uniqueness 
Estimates (Dependent Variable ~ CTBS) 



Grade 4 (N = 112) Grade 5 (N - 98) 



Predictor Squared Uniqueness Squared Uniqueness 

Cluster Multiple Multiple 



A 


.423 


.218 


.283 


.218 


B 


.148 


.037 


.028 


.021 


C 


.045 


.003 


.042 


.006 


D 


.177 


,054 


.094 


.023 


E 


.010 


.001 


.007 


.000 


ABCD 


.528 




.354 




ABCE 


.475 




.326 




ABDE 


.526 




.348 




ACDE 


.492 




.333 




BCDE 


.311 




.136 




ABCDE 


.529 




.354 





\ 



TABLE 4 

Squared Multiple Correlations and Uniqueness 
Sstixnates (Dependent Variable - ITBS) 

Grade 4 (U = 112) Grade 5 {U /- 98) 
" / 

I 

Predictor Squared Uniqueness Squared Unxqueness 

Cluster Multiple " Multiple 



A 


.432 


.-251 


.151 


.073 


B 


.162 


.029 


.047 


.055 


C 


-009 


.007 


.035 


.032 


D 


.112 


.037 


.047 


.085 


£ 


.003 


.012 


.014 


.012 


AECD 


.490 




.247 




ABCS 


.465 




.174 




ABD2 


-495 




.227 




ACDE 


.473 




.204 




BCDE 


-251 




.186 




ABCDE 


.502 




-259 





13 



12 



TftBLE 5 

Squared Multiple Correlations and Uniqueness 
Estimates (Dependent Variable - Acadenic Self Concept) 

Grade 4 (N = 112) Srade 5 (N - 98) 

Predictor Squared Uniqueness Squared Uniqueness 

Cluster Multiple Huliu.ple 



A 


.429 


.303 


.479 


-375 


B 


.036 


.001 


.030 


-021 


C 


.039 


.005 


.093 


-007 


D 


.067 


-014 


.062 


.031 


E 


.011 


.003 


.021 


-006 


SBCD 


.454 




.523 




ABCE 


.443 




.498 




JiBDE 


.452 




.522 




ACDE 


.456 




-508 




BCDE 


.154 




-154 




AECDE 


.457 




.529 
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TfiBLE € 



Squared Multiple Correlations and Cniqiieness 
2stiniates {Dependent V^fiable - SSath Self Concept) 



Grade 4 (I? = 1121 Grade 3 (U - 98) 

Predictor Squared Uniqueness Squared ifeiiqueness 

Cluster Multiple Multiple 



H 


.415 


.298 


.381 


.321 


3 


.086 


.004 


.014 


.017 


C 


-007 


.001 


.004 


.000 


D 


.065 


.022 


.046 


.014 


S 


-Oil 


.006 


.007 


.001 




.456 




.419 




SBCE 


.440 . 




.406 




SBDS 


.461 




.420 




ACDS 


.458 




.403 




BCDE 


.164 




.099 




ABCDS 


.462 




.420 
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Squared Multiple Correlations and Uniqueness 
£s£Lnates (sJependent Variable - attitude Toward Hath) 



Grade 4 jlJ = 112) Grade 5" {U - 98) 

Predictor Squared Unicaeness Squared Uniqueness 

Cluster Multiple ' ' Multiple 



A 


.207 


.165 


.233 


.149 


Q 

J> 




-Oil 


.045 


.063 


C 


.061 


.013 


.004 


.012 


O 


.054 


.033 


.103 


.081 


s 


.003 


.012 


.091 


.045 


ABCD 


.233 




.379 . 




-ABCS 


-262 




.343 




R3DZ 


.282 




.412 




ACDS 


. .284 




.361 




BCDS 


-130 




.275 




ABCDS 


.295 




.424 
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Sqiiared Multiple Correlations and Uniqoieness 
ZstisaCes {Dependent Variable - External locus of flontrbl) 

: ' ^ 7;: 

Grade 4 {U ^ 112) . Grade 3 jli - 983 

Predictor Squared Uniqueness Squared Uniqueness 

Cluster Multiple Multiple 



A 




102 


.402 


-245 


B 


.039 


"47 


.106 


.102 


C 


.008 


.090 


.035 


.001 


D 


.082 


.018 


.042 


-070 


Z 


.055 


.029 


.038 


.009 


ASCD 


.245 




.530 




ABCE 


.256 




.469 




ABDE 


.274 




.538 




ACDE 


.227 




.437 




BCDE 


.172 




.294 




ABCDE 


.274 




.539 
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Factor analysis vas sised as a scetfcod of reducing the large 
nii-ber of ctsearvational variables resulting in nine factors. 
Factor 1 contained those variables which involved verbal 
interaction between tutor and tutored pupil. Factors 2 and 6 
contained the tutor worXing and younger working variables, 
respectively — both frequency and time. Deaonstration 
techniques were divided azong Factors 3, 3, and 7. Factor 4 
was a bipolar tutoring style factor which contained recrini- 
nation which had a high negative loading and rapport which 
had a high positive loading. Factor 7 contained the frequency 
and amount of tice that tutors scade declarative statenents, and 
the three end of tutoring session skills — assignnent of 
eval«^^icn problens/ assignisent of practics problens^ and use 
of saotivating statements — were contained in Factor 8. 

Factor scorBS were corputad for each of the nine factors 
and were entered into regression equations along with the 
corresponding pre measure for each dependent variable. The 
regression analyses results are presented in Tables 9 to 15- 
The forsiat for each of the tables is identical. Tjie variables 
{factor nanes and premeasure) are listed in the left colirnn 
according to the order in which they ent:ered the regression 
equation. The reiaaining columns of the suzmary table list 
the jniatiple correlation^ the rtultiple coxxelation squared, 
the arjount of variance accounted for by the variable (R SQ 
change) / and the sin^^le correlation. In addition, the last 
two columns contain the raw and adjusted beta weights. 
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As vould be expected, the pxjpxl pretest scores accounted 
for the greatest aisount of variance in the post scores for each 
of the dependent measures. For the CTBS and ITBS, the combined 
tutorial skills and interpersonal behaviors accounted for only 
5% ar.d 3% of the variance Jji. those post scores. However, for 
the FWL — a test a gene^^feathematics ability "XJntaining both 
computational and natheaatics concept test items — 14% of the 
variance in the post s. res Was accoxmted for by the combined 
tutor "skills. The majority of that variance was attributable 
to the factor containing frequency and time tutors spent using 
declarative statements. 

There was more consistency in the results for the 
affective measures as the combined tutor skills and interpersonal 
behaviors accounted for eight to thirteen percent of the variance 
in those post scores. The end of session skills factor accounted 
for at least 2% of the variance for each of the affective 
measures, and the expanded notation factor accoimted for 1%, 
3% and 4% of the variance in the post measures of external locus 
of control, mathematics self-concept, and academic. self-concept, 

0 

respectively. Another consistency in the findings was associated 
with the style factor. For each of the affective measures, 
plus the FWL, the beta weight for this bipolar factor was 
negative indicating that the more criticism that occurred in 
the tutoring sessions, the more positive the attitude, self- 
concept, and FWL score. The finding is completely counter- 
intuitive and cannot be explained by the present data. 
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Discussion 

In the Teacher and Paraprofessional Tu4x>ring Sfcnaies^ a 
positive xeiatiopship between tutoring sla.lls and interpersonal 
behaviors of tutors to pupil outconies vas not clearly demon- 
strated, although a cluster of skills vhich contained the 
interpersonal behaviors of tutors provided z snail unique 
contribution to variance in pupil post scores. A clearer 
relationship between tutor skills and piroil outcomes was 
de23onstrated in the Cross-age Tutoring Study^ but only vhen 
all skills/ as represented by zhe factor scores^ were coribined. 

After exploring and rejecting various possible explana- 
tions for the failure of the desired relationships to 
asaterialize to any .significant degree, including inadequacy 
of the training and inadequate use of the tutoring skills , 
the research jnethodology used in the collection of the 
observational .data was examined- 

The data which formed the basis of the regression 
analyses consisted of frequency counts indicating the nmdber 
of times that a particular skill was used in the tutorial 
setting • Even with the a priori cliistering of skills in the 
Teacher and Paraprofessional Studies / and the statistical 
clustering of skills in the Cross-age Study, the fact remains 
that the bases for those clusters of skills were frequencies. 
A laore appropriate question in these aiialyses might have 
concerned itself,* not with the quantity of skill usage, but 
with the qiiality or appropriateness of a particular skill 
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being used- Exanination of the resialts of the cc-mimity 
regression analyses in tfce ^Teaciher ar.d Paraprofessionai 
studies showed rhat, after the variance attribatable to prpil 
pretest scores was accomted for, the greatest ariotmt of the 
regaining variance, on each dependent variable, was accoimted 
for by the cluster which contained the tutor interpersonal 
behaviors. Similar results were obtained in the Cross-Age 
Study- It is possible that these iii..erpersonal 3behaviors, 
which were saore dependent upon what pai^cular tutored pupils 
did in the tutoriag session than the skills emphasized in 
Minicourse 5, deiaonstrated laore positive relationships to 
pupil outcomes because tb^y were riore appropriately used. 
Although the data collected in the three Math Tutoring Studies 
cannot provide definitive answers to this question, it is 
certainly an area which should be addressed in future studies 
which seek to 'denionstrate relationships between teaching skills 
and pupil outcomes. 

Although the results of tli^ Math Tutoring Studies raise 
as many questions as they answer/'^they are isroortant as^^a 
point of departure for other researchers to use in formulating 
Bore appropifiate methodological models which demonstrate the 
relationship between teaching and pupil outcomes which we 
intuitively believe exists. 
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Heguests for copies of the final reports cf the lHaxh Tutoring 
Studies should be addressed toz 

Dr. Beatrice Ward^ dissociate Director 

Tar West laboratory for Educational 
Research and Develcranent 

1855 FolsQTi Street 

San Francisco, California 94103 
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